Zhiyuan Research Institute has launched a dataset called Infinity-Instruct, which comprises millions of instruction tuning data aimed at enhancing the performance of language models in dialogues and other areas. Recently, Infinity-Instruct has completed a new round of iterations, including the Infinity-Instruct-7M foundational instruction dataset and the Infinity-Instruct-Gen dialogue instruction dataset.

Tencent Youtu Lab and Shanghai Jiao Tong University released a comprehensive review focusing on dataset evaluation and selection for instruction tuning to enhance large model performance. The study aims to help large models grasp the essence of natural language processing by analyzing data quality, diversity, and importance to guide the construction of efficient and critical datasets. It highlights that data quality directly impacts tuning effect....